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I .  Introduction 

The  stochastic  processes  variously  called  branching,  birth, 
or  multiplicative  processes  have  been  considered  by  writers  in 
many  different  fields  during  the  past  eighty— odd  years.  We  shall- 

f 

not  try  to  characterize  such  processes  mathematically,  although 
certain  related  mathematical  properties  will  appear  in  all  the 
processes  we  study.  Physically  speaking  we  may  say  that  they 
represent  the  evolution  of  aggregates  or  systems  whose  components 
can  reproduce,  be  transformed,  and  die,  the  transitions  being 
governed  by  probability  laws.  The  examples  which  have  been  most 
frequently  considered  in  applications  are  the  propagation  of 
human  and  animal  species  and  genes,  nuclear  chain  reactions, 
and  electronic 'cascade  phenomena.  The  first,  and  probably  best 
known  mathematical  model,  which  we  shall  consider  in  Section  11, 
ajose  in  connection  with  the  problem  of  "the  extinction  of  family 
surnames,"  and  was  treated  by  Galton  and  Watson  [1^  as  far  back 

as  1873. 

As  we  should  expect,  the  mathematical  models  which  are  simple 
enough  to  make  possible  a. thorough  analytic  treatment  of  the 
subject  are  often  radical  oversimplifications  of  reality.  Hever^ 
theless,  certain  practical  applications  of  the  theory  have  been 
possible. 
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For  a  good  historical  account  of  the  subject,  including  many 
references  to  applications,  as  well  as  interesting  original  work, 
Ve  refer  the  reader  to  papers  by  M.  S.  Bartlett  [2j  and  David  G. 
i\ndall  fj]  .  Their  bibliographies,  together  with  that  at  the 
en\  of  this  paper,  give  fairly  corrprehens'.ve,  although  not 
comj^etely  exhaustive,  references  to  what  h.as  been  written  in 
the  f»ld.  It  is  unfortunate  that  some  work  done  during  the  war, 
and  cls\^fi|d,  is  still  not  available. 

pap^r  considers  a  number  of  stochastic  processes 
which  have  b^n  used  as  models  for  br^ching  phenomena.  ehilj. 

^kft-V*i*^^»*Mii>BT^^concern4iM^i^^limiting  theorems  and  limiting 
distributions  giving  the  behavior  of  the  systems  studied  after 
long  periods  of  time.  One  pattern  recurs  often  enough  to  make 
the  following  statement  plausible,  although  a  general  mathematical 
formulation  has  not  been  given^^ttb  iu  »tive«ely  ewggeebeiJ "lij  - 
reeults  of  Everett  and  Ulaa  [4j  a\d 
and  Baliman  and  Harris  [b]. 

Consider  a  family  of  objects,  ^iach  object  is  described  at 
a  given  instant  uf  time  by  a  vector  quantity  x,  wficre  x  may 
describe  the  age,  energy,  position  in  space,  or  a  combination 
of  these  or  other  traits.  The  quantity  x  for  a  given  object  may 
vary  with  time  in  a  deterministic  or  a  random  fashion.  In 
adlition,  there  is  a  law  for  the  probability  that  an  object  of 
"type”  X,  existing  at  time  t,  will  produce  (or  be  transformed 
into)  a  given  aggregate  of  objects  at  time  t’  >  t;  for  example. 


various  results  of 


2. 
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we  may  prescribe,  for  the  disjoint  sets  X,,  X2 ,  ***,  of  x— valuea 
and  the  intef.ers  k,  ,  ,  *•*,  the  probability  that  starting  with 

an  object  of  cyfe  x  at  t,  there  will  be  k,  objects  at  t’  whose 
x-coordinates  belong  to  X,,  ^  1^,  ^  ^  ^ 

etc.  Thus  we  might  prescribe  the  probability  that  an  object  of 
age  .X  be  transform'd  into  k)  objects  of  age  <  x,  and  k2  of  age  > 

X,  . 

Now  let  N(t)  be  the  number  of  objects  at  time  t,  and  let 
P^(X)  be  the  "distribution”  of  the  population  at  t.  (P^(X)  is 
not  a  probability  distribution;  it  is  a  random  ouantity  giving 
the  number  of  objects  in  the  set  X  at  t.)  Assume  that  the  system 
aealt  with  is  one  which  will  grow  in  size  without  limit  as  t-->cx). 
Then,  under  various  conditions,  it  will  be  true  that 

(a)  N  { t )  /  h  [}J  ( t  converges  with  probability  1  as  t->cD  to 

a  random  variable .  being  the  expected  value  of  N(t). 

(b)  P^(X)/N(t)  converges  with  probability  1,  in  some  sense, 

to  a  constant  distribution  W(X);  (i.e.,  the  same  for  all  realiza-- 

lions  of  the  system.) 

It  ap;_ears  to  be  a  matter  of  considerable  interest  to 
determine  broad  conditions  under  which  (a)  and  (b)  are  true. 

They  will  be  demonstrated  for  some  of  the  systems  considered  in 
this  paper. 

In  addition  to  limiting  theorems  we  shall  consider  various 
results  especially  applicable  to  the  classical  model  of  Galton 
and  V.'atson,  and  its  multidimensional  generalization.  In  particular 


we  shall  describe  briefly  some  work  of  the  Russian  school  not  yet 
available  in  English. 
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II.  The  Simple  Iterative  Scheme 

In  this  section  we  consider  the  original  Galton-Watson  ocodel. 
It  has  been  used  by  many  writers,  and  many  of  its  properties  have 
’  been  discovered  and  rediscovered  several  times.  In  spite  of  its 
I  simplicity  it  is  of  considerable  importance,  partly  because  there 
I  are  Intrinsically  interesting  mathematical  problems  connected  %d.th 
it,  many  of  then  still  unsolved;  partly  because  many  results 
connected  with  it  can  be  wholly  or  partially  generalised  to  more 
complicated  models. 

In  this  scheme  we  consider  an  initial  object  (ancestor) 
forming  the  zero— generation.  This  object  has  probabilities 
p^,  r  •  0,  1,  i,  •••,  of  producing  r  objects,  which  will  con¬ 
stitute  the  first  generation.  Each  object  in  the  first  generation 
has  the  same  probabilities  as  the  ancestor  of  producing  a  given 
number  of  ’’children independently  of  what  is  produced  by  any 
other  object  in  its  generation  or  preceding  ones.  Formally  we 
can  define  the  sequence  of  random  variables  z^,  n  “0,  1,  •**, 
where  z  is  the  number  of  objects  in  the  n^^  generation,  by 


I  P(z,  -  r)  -  p^,  r  -  0,  1 ,  • • • , ' 


and  the  requirement  that  if  z^  ■  j,  then  *^^4,  is  the  sum  of  j 
independent  random  variables  each  having  the  same  distribution 
as  z, .  (If  z^  -  0,  z^^j  -  0. ) 

We  define  the  generating  function  of  Z|  by 
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f (3)  -  Y  p  . 
r-l)  ^ 

Throughout  Section  II  we  shell  assume,  unless  the  contrary  is  stated, 
tlia’"  ^  r  <  CD.  This  insures  the  existence  of  second  moments  for 
all  the  random  variables  with  which  we  shall  be  concerned.  We  shall 
also  exclude  the  trivial  cases  ( 1  )  Po  Pi  "  •  »  ai^d  (2)  f(s)  ■  s 
for  some  Integer  k. 

The  following  facts  fire  then  well  known. 

(a)  The  generating  function  of  is  f^is),  defined  by 

f  0  (  s  )  -  s 

■'»  ’**• 

(b)  Let 

Lz ]  ■  f '  (  1  )  “  m 

Variance  (zj)  ■  f "  ( 1  )  *  m  -  •  cr^ . 

Then 

Lz  “  , 

r  ’ 

(1)  Var  (z  )  ■  O' -  1  )/(m^  —  m )  ,  m  /  1; 

n 

Var  (  z  )  =*  n<r^  ,  m  ■  1  . 
n 

(c)  If  ra  V  1  the  probability  is  1  that  z^  ■  0  for  some  n. 

If  m  >  1,  let  a  be  the  unique  root  in  the  half  open  interval  [0 ,  1) 
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of  the  equation 

a  -  f (a) . 

Then  with  probability  a,  ■  0  for  some  n  and  with  probability 
1  -  a, 

(d)  If  m  >  1  the  random  variable 

w  -  z  /m" 
n  n' 

converges  in  distribution  to  a  random  variable  w  whose  moment- 
generating  function  ^{3)  satisfies 

(2)  ^^(ms)  -  f[y{(s)],  Re(s)  <  0, 

^^(s)  «  Ee®'*  . 


As  we  shall  see,  many  properties  of  the  distribution  of  w  can  be 
deduced  from  (2). 


The  result  (a)  is  originally  due  to  Galton  and  Watson  and 
has  been  rediscovered  a  number  of  times;  (b)  and  (c)  have  likewise 
been  found  several  times;  (d)  appears  to  be  due  first  to  Hawkins 
and  Ulam  [7]  ana  was  obtained  independently  by  Yaglom  [8], 

We  next  consider  convergence  of  the  actual  sample  sequences 
w^.  For  this  purpose  we  note  the  important  relations 


13) 


fc(z  |z  ) 
n^p  n 


•  ‘■‘Vpl'n-  *n-i-  ••••  *0’ 


m'^z 


p  -  0,  1  ,  •  •  •  ; 


E(z  ^  z  ) 
n-^p  n 


m^Ez^  , 


p  -  0,  1  . 


e  •  • 


I 


we  have 
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From  (3),  ana  the  aefinitiori  of  w  -  z  /m^  . 

’  n  ’ 


iu) 


E(w  [w  )  ■  E(w'  !w  ,  W  ,,  •••  Wn ) 

n-^ p '  n  n-»p  ‘  n  *  n— i  ' 


n 


p  -  U,  1 ,  •••  ; 


L ( w  w  )  -  Ew*  , 
n+p  n  n* 


p  -  0  ,  1  ,  •  •  •  . 


T^le  relations  (3)  and  (4),  or  sonethinp;  analogous,  hold  in  all  the 
models  we  shall  consider. 

We  have  alreaay  mentioned  tfat  if  m  v  1  the  secuence  and 

hence  w^,  converges  to  u  v.ith  probability  1.  If  m  >  1  we  have 


Theorem  1  .  ^  1  conyerF.es  to  a  random  variable  w  with 

probability  1 , 

The  proof  follows  from  (4),  according  to  which 


(5) 

From  ( 1  )  , 


2  o  2 

E(w  ^  -  w  )  '  Ew*’  -  Ew 

n-^p  n  n+p  n 


(6) 


EWr,  .  1  * 


n,  ^  > 

ra  -  m  m  ( m  —  m  ) 


whence 


(7)  ^^''n*^p  ”  ’  m  >  1. 

From  (7)  it  follows  that  w  converges  in  mean  sruare  to  a  randcmj 

n 
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variable  w  and  that 

(8)  Z  •  Z  0(ni”")  <  ®  . 

n-1  "  n-1 

From  (6)  it  then  follows  that  converges  with  probability  1  to  w. 

It  should  be  noted  that  by  virtue  of  (4)  the  random  variables 

w_  form  what  Doob  has  called  a  martini^ale.  Moreover,  since  w  >0 
n  '  n  — 

we  have  "  bw^  ■  1.  Since  the  quantities  sre  uniformly 

bounded  it  follows  from  a  theorem  of  Doob  [9^  that  the  w^  converge 
with  probability  1.  Moreover,  this  argument  does  not  require  the 
existence  of  second  moments,  which  we  have  assumed.  However,  the 
argxifflent  depending  on  second  moments  appears  easier  to  generalize 
to  more  elaborate  models.  It  also  gives  a  convenient  bound  for 
the  rate  of  convergence. 

The  functional  equation  (2),  sometimes  called  aoenigs*  equation, 
sometimes  Schroeder's  equation  []l0j,  ([l  lj  ,  *fber  19th  century 

mathematicians  who  studied  it,  can  be  used  to  find  the  behavior  of 
0(s)  on  the  imaginary  s-axis,  the  negative  real  s— axis,  and, 
if  it  exists,  on  the  positive  real  s-axis.  Then,  using  various 
kinds  of  Tauberian  theorems,  properties  of  the  distribution  of 
w  can  be  inferred.  Some  details  can  be  found  in  f5]]  1  but  a  great 
deal  remains  to  be  done  in  this  direction. 

ae  now  consider  some  limiting  theorems  of  a  different  sort. 

The  fact  that  z^  — ^  0  when  m  <  1  makes  the  limiting  situation  look 
uninteresting.  However,  Yaglom  [8]  noticed  that  we  get  nontrivial 
limiting  distributions  in  this  case  if  we  consider  the  conditional 
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d  i  r  l  r  i  t  ut,  i  or.  of  z  ,  ’ivon  t.hr.  t,  z  /  0. 

n  n 

Theorem  I  (Y<ip'''om).  Let  the  cond  i ti  or.o  1  generot  1  r.^  f  ^nct  1  on 

oh  z^,  /.iven  z^^  /  0, 

00  ^  f  (s)  -  f^(0) 

g  (s)  '2!s^F(z  'r|z  /  O)  ■=  — - p-7 — ? —  . 

n  n  ‘  n  1  -  1  ^  u 

r^l 

Ti.er  _y]  m  , 

lim  g  (s)  “  g(s) 
n  ->u) 

v.hero  g  (  c  )  Su  t  i  s  Ties  the  fun  ci  i  onal  equation 

C  [f  (  £  )]  -  rr.f,(  0  )  ♦  1  -  m,  js,’  ^  1  , 

gd)  -  1  .  g'(l')  -  K, 

K  -  lim  [l  -  f  (0)J/m^  . 

L.  -I  ' 

n->au 

•  4 

The  proof  ia  carried  out  using  the  classical  work  of  Koenigs. 

The  limiting  distri outi one  considered  in  Theorems  1  and  ^  can 
assume  a  great  Vt^riety  of  forms  for  any  value  of  m,  depending  on  the 
exact  form  ol'  f(s).  It  is  therefore  noteworth.y  th^t  when  m  -  1 
there  is  a  universal  limiting  ois  tri  oution  ,  ar  in  iheorerr.  3, 

first  proved  for  the  special  case  fis)  ■  e^  '  l  sher  [l  3j • 

_  3 

Theorem  3  (Yaglora).  assume  m  •  1  and  y  r  p^  ^  cd.  Then 
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lim  P[2zy(nf’’(l))  <  u|z^  /  O]  -  0 
n-»a) 

JU]  u  <  0  and  1  -  e~'*  ^  u  >  0 . 

If  m  ■  1,  fc(z^|z^  /  0)  nf*’(l)/2,  n— >00.  The  proof  of 

Theorem  3  is  carried  out  using  a  theorem  of  Patou  [jl4j  on  iteration 

of  functions  in  the  neighbortiood  of  a  fixed  point  with  derivative  1  . 

«nother  type  of  limiting  distribution  is  of  come  interest  in 

the  case  m  ■  1.  «e  may  consider  the  distribution  of  z  ,  given 

n 

Zn^p  /  0,  where  p  is  a  positive  Integer.  Tb'*  generating  function 
of  this  distribution  approaches  a  limit  as  n— >00,  the  limit  being 
3f^(s).  In  fact  we  can  define  in  this  way  a  conditional  probability 
measure  on  the  subspace  (of  zero  measure)  of  sequences  (>^)  which 
never  vanish.  A  precise  statement  of  the  limiting  result  is  clumsy, 
but  it  may  be  given  informally  as 

Theorem  4*  nssume  m  -  1  ,  21  ^  Suppose  that  n  and  n’  —  n 

are  both  large .  If  extinction  has  not  occurred  after  n’  generations 
then  2j^/(1  *  no^ )  has  approximately  the  probability  law  whose 
density  is  4ue  ^'^du,  u  >  0. 

The  proof  is  by  means  of  the  theorem  of  Patou,  using  the 
relation 

f:(s)  -  TT^f[f.(8)3  . 

"  J-0  J 

Besides  z^,  another  random  variable  of  interest  is 

Z  •  1  •»  z  )■*••••  , 
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where  Z  is  the  total  progeny  produced  in  all  generations.  We  have 
seen  that  if  ra  <  1 ,  Z  is  finite  with  probability  1  ,  and  we  can 
consider  its  probability  distribution. 

Let  ^{s)  be  the  generating  function  for  Z, 

wis)  ■  T  Q  . 

r«1  r*1 

Hawkins  and  Ulam  [72  •nd  Otter  5j  have  shown  that  Q{s)  satisfies 
the  functional  equation 

(9)  Q(8)  -  ^  Q  8*"  -  8f  |Q(8)3  ■  8  21  • 

r-1 

Otter  has  investigated  the  equation  (9)  and  has  obtained  an  asymptotic 
expression  for  the  coefficients 


Theorem  5*  (Otter)  Let  q  ^  the  highest  common  factor  of  the 
subscripts  of  the  non vanishing  p^.  Then 
(a)  If  m  ■  1  . 

-j/i 

•in - -  .  n->®,  for  n  5  l(q)  ; 

"  V2nf*‘{l ) 


^n  “  n  ^  l(q) . 


(b) 


Jf  m  <  1  , 

Si 


1.2TTaf"(Q{0«.)) 


n-^tt,  n  =  1  (q)  ; 


•  0.  "  n  ^  1(<))  , 


where  OL  is  the  radiu-  of  convergence  of  Q( s )  and  CX-  >  1  if  ra  <  1 , 
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Further  results  and  details  can  be  found  in  Otter’s  paper. 
Otter  bases  his  work  on  a  probability  measure  defined  not  on  the 
space  of  sequences  *5ut  on  the  space  of  ’’trees."  For  example, 

one  distinguishes  the  progeny  of  the  second  son  of  the  fourth 
son,  etc. 

Me  shall  only  mention  another  group  of  problems  about  which 
little  is  Known,  those  concerned  with  finding  the  distribution 
of  upper  or  lower  bounds  for  as  n  ranges  over  various  sets  of 
Values.  The  distribution  for  the  number  of  generations  to 
extinction,  in  case  m  <  1 ,  has  been  discussed  in  fpj.  Another 
distribution  of  interest,  about  which  nothing  seems  to  be  known, 

is  that  of  sup  z  ,  if  m  <  1 ,  and  of  sup  s  /m”  if  m  >  1 . 

1<n<i»  "  ”  1<n<a)  " 
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III.  Th>  Ittmtlvia  lafcw  • 

Ve  consider  In  this  section  the  generalization  of  the  model  of 

Section  II  to  the  multidimensional  case.  Specifically,  we  consider 

a  sequence  of  vector  random  variables  z„  ■  (z„,  *•*,  z„)  where  z_ 

n  n '  '  n  n 

represents  the  number  of  objects  of  the  i^^  type  in  the 
generation.  (We  shall  us«>  bold— face  lower  case  letters  for  vectors, 
bold— face  upper  case  letters  for  matrices.)  The  types  1,  ***,  k 
may  be  thought  of  as  representing  energy  levels  in  the  case  of 
nuclear  particles,  or  age  groups  in  the  case  of  biologicol  organisms, 
etc.  We  assume  that  an  object  of  type  i  existing  in  the  n^^ 
generation  has  a  probability  p^(r),  *••,  r^^)  of  producing  in  the 
next  generation  ri  objects  of  type  1,  ••*,  rj^  objects  of  type  k, 
independently  of  past  hist'^ry  or  of  what  is  produced  by  other  objects. 
The  probabilities  p^(r|  ,  •••,  ,  together  with  specification  of 

the  initial  aggregate  Sq  determine  the  probability  law  for  the 
sequence 

Much  of  the  theory  of  these  processes  has  been  developed  by 
Sverett  and  Ulam  >  Sevast'yanov  fl63i  and  Sevast'yanov  and 
Kolmogorov  ,[173 .  We  shall  summarise  some  of  their  work  and  give 
some  further  results.  I  wish  to  thank  Drs.  Everett  and  Ulam  for 
permission  to  quote  some'of  their  results  which  have  not  yet 
appeared  in  the  Journals. 

Define  f^(s)  and  l"1»***i*tf  n“1*2,  ''^by 


i^(«)  -  4(«)  - 


i  **k 

p*(r,  ,  •••,  r.  )s,  •••  s,,  , 


fi(.)  - 


**1 

X  ._**^*i**'i*  *  *  * »  *n  "*'k^®’  81 


/ 
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where  is  the  expected  nunber  of  objects  of  type  j  produced  in 
a  single  generation  by  a  single  object  of  type  i.  We  exclude  the 
trivial  case  where  all  the  m^j  vanish. 

Differentiation  of  (1)  at  Sj  •  •  •  •  -  Sj^  •  1  gives 

(2)  E  -  IqM''  . 

ee  shall  consider  the  second-moment  matrix  later.  We  shall  assume 
that  the  second  moments  E(z|^z^),  i,  J  ■  1,  •••,  k,  are  finite. 

Since  all  elements  of  M  are  nonnegative  we  can  use  the  well- 
Known  fact  that  M  has  a  positive  characteristic  root  A  which  is 
at  least  as  large  in  absolute  value  as  any  other  characteristic 
root  and  which  corresponds  to  a  characteristic  vector  all  of  whose 
elements  are  nonnegative.  If  all  the  m^j  are  positive,  X  is 
simple  and  larger  in  absolute  value  than  any  other  cliaracteristic 

f 

root,  and  every  component  of  the  corresponding  characteristic 
vector  is  positive.  We  shall  reserve  the  letter  X  throughout 
Section  III  for  the  largest  positive  characteristic  root  of  M. 
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By  analogy  with  the  classification  of  stcten  in  Markoff  chains 
we  can  Introduce  the  notion  of  a  closed  group  of  types  ^17]),  a  set 
of  types  whose  progeny  all  belong  to  the  set.  A  closed  group  is 
i nd e c’ompoeable  if  it  does  not  contain  two  disjoint  closed  subgroups. 
If  the  types  1,  ***,  k  form  an  indecomposable  group,  we  shall  speak 
of  an  ladecon posable  system .  A  closed  group  is  called  a  final 
group  if,  with  probability  1 ,  the  progeny  in  the  next  generation  of 
on  object  in 'the  group  is  exactly  one  object  in  the  group,  and  if 
the  group  contains  no  proper  closed  subgroup  with  this  property. 

A  process  such  that  for  any  Zq  complete  extinction  is  bound  to 
occur  is  called  dfgenerate . 

Theorv  6  (Sevaat 'yanov) .  ^  order  that  a  process  be  degenerate  it 

is  necessary  and  sufficient  ^at  (a)  A  S  ^  and  (b)  the^e  are  no 
final  groups.  , 

We  shall  say  that  a  process  is  completed  if  only  objects 
belonging  to  final  groups  remain.  Suppose  that  there  are  K  final 
groups,  K  <  k,  and  let  q^(rj  ,  ••*,  rj^)  .be  the  probability  that  if 
the  initial  object  is  of  type  i,  the  process  will  be  completed, 
with  r,  objects  in  final  group  1,  ••*,  in  final  group  K,  remaining. 
For  simplicity  (and  in  connection  with  Theorem  7  only)  we  can 
suppose  that  an  object  which  dies  is  transformed  into  a  particular 
type  which  represents  a  death  state.  This  type  then  forms  a  final 
group. 

Let  H|  ,  •**,  Hjj  be  sets  of  integers,  being  the  numbers 
corresponding  to  the  types  in  the  r^^  final  group.  Let 
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f^is)  -  X  •••,  r|^)s/“*  Sjj*  . 

Ttieorea  7.  (Sevast’yanov  and  Kolmogorov).  The  functions  ‘^^(s), 
for  [s I  <  1 ,  are  unlcuelv  determined  hr  the  equations 

(3)  -  •••,  1  ^  H,  ♦  •••  ♦.Hj  ; 

V'^(9)  “  8r  ’  i  ^  r  -  1,  •••,  K. 

The  quantities  V'^(l)  <  1  are  the  probabilities  of  "completion 
as  previously  defined,  If  the  Initial  ancestor  Is  of  type  i,  and 
can  be  obtained  by  solving  (3)  with  s  ■  1. 

If  there  are  no  final  groups,  then  we  may  consider  the  proba¬ 
bility  a^  that  extinction  will  occur,  if  the  initial  object  was  of 
type  i  (dropping  the  convention  that  the  "death  state"  is  one  of 
the  types.)  The  quantities  a^  are  then  determined  by  the  equations 

(4)  -  f^(a’ ,  •••,  a*^),  i  ■  1,  •**,  W. 


tf 


I  If  we  make  the  further  assumption  that  for  each  i,  j  •  1,  •••,  k 
• 

I  there  is  a  positive  probability  that  an  object  of  type  i  will  have 

I  among  its  progeny  in  some  future  generation  an  object  of  typo  j, 

then  a^  ■  1  for  a  single  i  implies  a^  ■  1  for  all  i,  and  a^  •  1 
I.  " 

i  if  and  only  if  A  <  1 • 

Theorems  6  and  7,  in  slightly  leas  general  form,  were  proved 
by  Everett  and  Ulam  [43  • 

We  shall  say  that  a  system  is  positively  regular  if  A  ia 
simple  and  larger  in  magnitude  than  any  other  characteristic  root 
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and  If  for  avary  1,  j  ■  1,  ***,  k  thare  is  a  positive  probability 
that  an  object  of  type  i  will  have  in  some  generation  of  its  progeny 
an  object  of  type  J.  (In  other  words,  for  each  i,  J  there  is  an  n 
such  that  the  element  in  the  i^^  row  and  j^^  column  of  M*'  is  positive. 
If  every  element  of  M  is  positive,  the  positively  regular  case  is 
assured. 

In  the  positively  regular  case  we  have,  from  matrix  theory, 

M  -  Am,  ♦  N 

where  K,M,  •  M,  ,  M,N  ■>  0,  and  every  element  of  M,  is  positive.  The 
matrix  M,  has  rank  1  and  in  fact  has  the  form 

M,  - 

where  are  the  components  of  the  right  eigenvector  of 

A  end  t  **•»  those  of  the  left  eigenvector.  The 

components  and  are  all  positive,  and  with  the  proper 
normalization  we  then  have 

•  « ' 

Moreover,  there  is  an  (X,  ,  0  <  CX,  <  1  ,  such  that 

l!H"lt/A"  ■  0(0.?).  !>-»■» 

where  Qll^i}  is  the  sum  of  the  absolute  values  of  the  elements  of 
During  the  remainder  of  this  section  we  consider  only  the 
positively  regular  case  with  A  ‘I  * 


-19“ 

P-1 52 

rev.  6/14/50 


^1  Theorem  8a.  Suppose  that  X  >  1  and  the  svstea  Is  positively 
^regular.  Then  the  random  variable 

?!  '  n  n* '  ^  ^n 

converges  with  probabil itv  1  ^  a  random  variable  S. 

i  • 

it 
! 

Theorem  8b. (Everett  and  Ulam).  Suppose  A  ^  ^  and  the  system  i? 

^^positiyelv  regular.  Let  the  numbers  a^  <  1  ^  defined  by 

'-eouatlons  (4).  Suppose  the  initial  ob.lect  is  of  type  1;  then 

\  d  k 

^f  the  system  does  not  become  extinct  the  ratios  *jj**n*  •••  **[1 
approach  with  probability  1  the  ratios  •  •**  sL  the 

r 

components  of  the  left  eigenvector  of  X  . 

J' 

Theorem  6b,  which  appeared  in  a  declassified  Los  Alamos 

j 

report  [4]  issued  in  1948,  is  part  of  extensive  results  to  be 
.published  later.  As  stated  by  the  authors,  it  applied  to  the 
space  of  ’’trees"  or  ’’graphs";  cf.  the  remark  on  Otter’s  work 
in  Section  II.  As  we  shall  see,  8b  can  be  used  to  prove  8a, 

However,  we  shall  also  outline  a  simple  method  which  proves  the 

\ 

two  together,  and  has  the  merit  of  giving  an  error  tern. 
Analogously  with  (3),  Section  II,  we  have 

(b)  •  ‘n"'’ • 

If  we  divide  both  sides  of  (6)  by  and  multiply  both  sides 

on  the  right  by  the  column  vector  the  right  eigenvector  of 

,X  •  we  get 
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(7) 


i,  J1_".E_  u  I  .  _n -  .  _nj_ 

'  >n-*-p  n  n  +  p  vH 

.  A  I  /  A  A 


Let  E  denote  the  scalar  random  variable  defined  by 
vn  ■' 


'f  ■  z  /  A  ^  • 


Then  (7)  gives 

(8) 


^  n 


Use  of  the  theorem  of  Doob  referred  to  in  Section  II  proves  convergence 
with  probabilitv  1  of  the  secjence  Knowing  from  Theorem  8b  that 

the  direction  of  z^  (if  it  aoe?  not  eventually  vanish)  approaches  a 
limit,  the  fact  which  we  have  just  observed,  that  the  scalar  p.'oduct 
/  X  converges,  proves  that  each  component  of  the  vector 
2^/  converges,  and  Theorem  8a  follows. 

as  en  alternative  proof  of  Theorems  8a  and  8b  we  consider  the 
sequence  ■  z^/X^.  I  rom  (6) 

(9)  ^  /  X  ^  . 

n'^p'  n  n 


Kelation  (9)  looks  very  much  li^ce  its  one  dimensional  analogue,  (4), 
Section  II.  In  fact,  if  M  has  an  inverse,  the  resemblance  can  be 
made  more  striking.  However,  this  line  of  argument,  based  on  Doob's 
theorem,  has  not  been  carried  out.  Instead  we  argue  on  the  moments 
as  follows.  From  { ))  and  remarKs  madj  below  it  will  appear  that 
1 


■  0(a2). 


<  '  *  1  •  •  •  L(  • 

A  ,  J  •  »  f  ^  f 


0  <  (X2  1 . 
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In  particular, 

(11) 


i  ■  1 ,  • • • ,  k. 


W 

I 


Thus  for  each  i,  converges  with  probability  1  to  a  random  variable 

w^  and  we  have  Theorem  3a.  We  shall  see  below  that  the  second 

moment  matrix  of  the  w^,  (Ew^w^)  has  rank  1.  Thus  the  w^  are 

perfectly  correlated.  Also,  for  each  1  and  j,  w  ■  0  if  and  only 

if  w*^  ■  0,  with  probability  1.  Hence,  if  w^  /  0  the  ratio  w^/w*^ 

is  the  same  as  the  ratio  Ew^/£w^,  with  probability  1.  Since,  as 

we  shall  see,  Ew^/Ew*^  -  Theorem  8b  follows. 

To  obtain  (1O)  we  examine  the  second  moment  matrix  of  z  . 

n 

If  u  •  (u^)  and  v  ■  (v^)  are  vectors  we  denote  the  matrix  (u^v*^) 
by  u’v.  If  u  and  v  are  random  variables  then  E(u'v)  •  (e(u^v'^)), 
while  the  variance  of  u  is 

E(u'u)  -  Eu*Eu  -  (eIu^u-^)  -  Eu^Eu^  )  . 

We  shall  use  M*  to  denote  the  transpose  of  M. 

Let  e^.  be  the  k-component  vector  with  1  in  the  r^^  place 
and  zeros  Slsewhere.  Define 


^  •  E(z|z,Jzo  -  e^)  -  (e(zJzJIzo  -  e^.))  ; 

if  i  /  J; 


Eizjz^lzo  -  ^  - 


Si 


I  «  si 

®k 


dSi 


■®k“^ 


3sj^38j 

-  e[(z}’)  -  Z|  |zo  -  ej  ; 
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-  variance  of  z,  ,  ^iven  z^^  "  ^r* 


-  -  E(  z,’  jzo  -  e^)E(z,  Izo  "  e^) 


b  -  M’e’e  M  ; 
r  r  r  ’ 


C  “  E(  z  ’  z  )  ; 
n  n  n  ’ 


q  “  Ez  ■  ( ) 


From  elementary  considerations  we  get 


(12) 


k  , 

C  ,  -  M'C  M  >  Y  V.q^ 

n*1  n  t^n 


n  “0,  1  ,  •  • * , 


■  ^0*0  » 


whence 


(13) 


_JT_  ^ 

A'"  ■  A' 


r  ,  1  k''‘  ^  '’i-1  \  k"  ^ 

~'”7  7  j?'  ~(>5’^#Fi)7=3 


From  (13)  ueri ve 


(14) 


^  0(0^5), 


1  ; 


J  .  M;  Co  -  ^  Z  f  M,  . 

L  A  i-1  t 


(recalling'  that  I'li  -  I  im  where  --  hhe  i*""  component 


n->a) 


of  the  vector  Zo(I  -  M/ A^)  I  being  the  identity  matrix. 
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(15) 

New  c 

(1C; 

But  f 

(17) 

9 1  m  i  1 

have 

(IB) 

^ii3  , 

;  ) 


rrorr,  (I4)  ana  Che 

reiatior.  of  N 

*, )  1 0  y.  w  e  see 

0  h  3 1'  ia  s 

1  and  SuCic-t'ies 

,  m,  f  n^ 

0  -  M  -  , 

n  -  0 ,  1  ,  •  • 

• 

• 

enciaer  w  •  z  /  k  . 

n  n  ^ 

If  r.  ana  p 

are  nonnep^dCi  ve  integers, 

r  /  f 

1  V  / 

-  W  y  (  W  ^  — 

n  n^p 

“n>J  • 

f » 

-  £(  w’  w 

n  n 

1  -  c.  w 

♦  p  n  ♦  p  n 

)  . 

A^n^.p 

rom  J  5 )  ,  (  1 C ) ,  and 

(c)  . 

L  (  w  ’  w 

n  n-»p 

Hiz' z  ) 

\  .  ..  r.*D 

i.UCr,)*'’'  . 

1 

cn-^  p 

A 

[c  >  r( 

Ml]  j 

/ 

•  ClCL"), 

U  -  .  3  ^ 

T  . 

arlyLy>.’w  =  ^ 

^  n^p  n 

vlo)  ^  0*^'*ci* 

+  0  ( (Oc  j  )  .  Krcm  (1V),  (16) 

.  and  (U), 

Kegarainp-,  Che  a  1  st ri but  i  or.  of  w 

,  we  tiave 

dW  -  ZyM 

1  ‘  X  2^0  /^  ^  ( 

l  \  V\  •••. 

1  *'). 

nw ' £w  ■  I 

If.  f 

1  0  ^o*'*  1  "  1 

C  Q  1*1  1 

from  {  '  ^)  0.1. Cj  Me) 

Va.'  i^n  ce 

of  w  -  M 1 

4C 

A 

k  ^  \ 

■  X  S‘Vj IK,  . 
1-1  ' 

we 
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We  recall  that  it  tne  Voriance  matrix  of  Z]  ,  ^iven  Zq  ■  e^, 
and  S  ^  13  the  component  of  the  vector  Zq  ( i  -  /  '• 

The  being  perfectly  correlated,  and  the  random  variable 
S  of  Theorem  8a,  i.ave  the  same  distribution  except  fcr  constant 
factors. 

Let  ! s )  be  the  moment-renera 1 1  ng  function  of  S ,  if  there 
was  initially  one  object  of  type  i.  It  is  then  not  difficult  to 
show  that  the  functions  ^^(s)  satisfy 


(20)  f^  (j^'  (  s  ,  Ke(  s)  _  o  ,  i  1  ,  •  •  •,  k 

The  functions  ( s )  are  uniquely  determined  by  (20)  and  the  require 
ments 

(0 )  -  1  ,  io-)  •  +  •  ♦ '  ♦  2/'  ^ ) 

-  £( 3  I Zq  •  )  , 

Vvh:ere  e^  has  1  in  the  place  and  zeros  elscuvhere. 
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|1V.  Contlnuou*  Time  Parameter ,  Markov  Case 

r-  ^ 

Fell«r  [_18J  was  apparently  the  first  to  discuss  branching  or 

Jbirth  processes  where  a  continuous  tine  parameter  is  involved,  and 

I  since  then  there  has  been  an  extensive  literature.  For  references 

f  we  refer  again  to  Kendall  .  The  point  of  departure  for  these 

^'^reatments  has  usually  been  the  specification  of  functions  b(n,  t) 

and  d(c,  t)  where  b(n,  t)dt  is  the  probability  of  a  birth  and 

^  d(n,  t)dt  the  probability  of  a  death  between  t  and  t  dt  if  the 

^|8ize  of  the  population  at  t  is  n.  When  these  functions  are 

[^specified,  differential  equations  can  be  obtained  for  the  proba- 

Hibility  of  a  given  number  of  objects  at  t.  Most  treatments  have 

assumed  the  birth  and  death  rates  to  be  independent  of  the  age  of 

p the  objects,  although  allowing  them  to  depend  on  absolute  time. 

J 

.We  shall  discuss  the  question  of  age  dependence  in  Section  IV. 

The  model  which  we  now  consider  is  determined  as  follows. 


Consider  an  object  existing  at  time  t.  Assume  that  there  is  a 
probability 

b^t  ♦  o(/^t)  , 

that  the  object  is  transformed  into  r  objects,  r  "0,  2,  ), 
between  t  and  t  ♦  ^t ,  ^t  >  0 ,  where 

b"bo^b2^b3+  *••<00, 


and  a  probability  1  —  b^t  ♦  o(^t)  of  not  being  transformed.  We 
assume  that  the  transformation  probabilities  are  independent  of 
the  age  of  the  object  and  the  number  of  other  objects  existing. 
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Then  if  there  is  initially  a  single  object  at  t  ■  0,  and  if  Pj.(t) 
is  the.  probability  that  there  are  r  objects  at  t  we  have  the 
equations 

dp_(t) 

(1)  "fe  ■■  ■  (r  ♦  1  )boP^^|(t)-rbp^(t)  ♦  (r- 1  )bap^^  (t) 

♦  ♦  bj.p,  (t),  r  -  0,  1  , 

with  the  initia.  conditions 

(2)  p^(0)  -  0,  r  /  1, 

Pi  (0)  -  1 . 

Various  special  cases  of  equations  (1)  have  been  studied  both 
directly  and  by  means  of  the  generation  function 

(3)  F(8,  t)  -  21 

r-0  ^ 

which  satisfies  the  equation* 

(k)  -  5(.) 

where 

(5)  ^(s)  •  bo  -  bs  ♦  b^s*  ♦  •••. 

It  la  well  known  that  if  we  define 

fn(a)  •  P(s,  nh),  n  •  0,  1,  **•,  h  >  0, 

the  functions  f_(s)  are  the  successive  iterates  of  the  function 
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f(8)  •  fi(s)  -  F(8,  h).  Thus  every  scheme  of  the  sort  determined 

by  equations  (I)  has  a  simple  iterative  scheme  imbedded  in  it. 

The  converse  of  this  statement  is  not  true.  It  is  clear  that 

if  r(s)  is  an  arbitrary  generating  function  there  is  not  In  general 
B 

a  scheme  defined  by  a  set  of  equations  (1),  and  a  value  to  of  t 
I 

such  that 

(6)  F(8,  to)  -  f(8). 


This  is  obvious,  for  example,  if  fis)  is  a  polynomial  of  degree 
>  Mfe  are  thus  led  to  ask  under  what  circumstahcee  it  is 
possible,  when  a  generating  function  f(8)  is  given,  to  find  a 
family  of  generating  functions  F(8,  t)  obtained  from  equations  of 
type  (1),  with  F(s,  to)  -  f(s)  for  some  to*  To  be  precise  we  shall 
say  that  a  probability  generating  function  f(8)  belongs  to  class  £ 
(written  f  6  C)  if  there  exists  a  family  F(a,  t)  , 

F(s,  t)  -  ^Pj.(t)s** 


such  that 


(a) 

(b) 


( c) 

(d) 


r-0  ^ 


F[F(s,  t,  ) ,  t  J  -  F(s,  t,  ♦  t^) ,  t,  >0,  tn  >0, 

I*I  <  1; 

F(S,  1  )  -  f(s)  -  p^s'’  ; 


F(3,  t)  -  8  t  ^(s)  ♦  o(t),  t — >-0,  |sl  <  1  ; 
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be  subBt i tuted .  From  (d)  we  see  that 

U  ^ 


t  *=0 


where  ^(s)  is  some  iunctlon  deiined  for  |s|  <  1  and  o(t)/t  — >  0 
uniformly  in  a.  Some  kind  of  regularity  condition  is  necessary 
and  (d)  is  convenient,  although  weaKer-looking  aasuir.  j-t  i  ons  could 

5  )  ,  and 

^(s)  is  a  power  series  convergent  in  the  unit  circle. 

Using  classical  work  on  the  iteration  of  fun'^tions  and  the 
general  theory  of  Markov  processes,  we  can  now  aetermine  whether 
a  given  f  £  C,  provided  f(C)  •  Pq  ■  0 .  The  literature  on  iteration 
goes  back  to  Abel  and  is  vast.  1  should  like  to  thank  Profe^'sor 
David  Hawkins  wh.o  first  called  this  flela  to  mv  attention. 

We  note  that  if  pQ  ■  p)  ■  0,  f(s)  can  never  belong  to  class  C; 
ill  what  follows  we  set  aside  this  case  as  well  as  tl.e  trivial  case 
p,  •  1  . 


Tlieorem  9a.  ^  Po  d  <  pi  w  1  ,  a  ne cessa ry  and  sufficient 

condition  that  f  ( s )  belong  to  class  C  ^  tha  t  each,  of  the  nuant  it  i  p  s 
b^,  r  •  3,  *’*i  should  be  r.onnegat  ive .  where  the  b^  are  deter-mined 

by  the  recurrence  relations 


(B) 


bi  -  log  pi  . 


The  exact  value  of  bj  ■  -b  is  unimportant  so  long  as  it  is  negative; 
is  the  coefficient  of  8^  in 
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The  criterion  of  Theorem  9a  is  not  very  satisfactory  since  it 
is  often  difficult  to  apply,  and  since  it  does  not  give  any  obvious  ' 
ri^lationship  between  membership  in  class  C  and  the  general  analytic 
properties  of  f(s),  Ve  can,  however,  give 

Theorem  9b.  If  Po  "  ^  <  pi  <1,  and  f(s)  entire.  f(s)  does 

not  belong  to  class  C. 

We  show  first  that  the  criterion  of  Theorem  9a  is  sufficient* 
From  the  classical  work  of  Koenigs  [l03  we  know  that  if  f(s)  is  any 
function  analytic  in  a  neighborhood  of  s  ■  0,  with  f(0)  ■  0  and 
0  <  f’(0)  <  1,  there  is  a  family 

F(s,  t)  -  51 

r-1  ^ 

satisfying  (7)“ (b),  (c),  and  (d)  in  a  neighborhood  of  s  ■  0.  The 
function  ^(s)  satisfies  the  relations 

(9)  ^[F(s,  t)]  -  |(s)  , 

(10)  ■  ^Is)  , 

t 

(11)  ^’  ( 0 )  ■  log  P )  ,  ^’  ( 1  -)  -  1  Og  B.  , 

which  are  evident  from  (7)— (b)  and  (d).  Putting  t  "  1  in  (9)  gives 


(12) 


,^[f(s)J  -  ^(s)f'(s). 


l®I  <  1 
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From  (  1  )  it,  IS  c^ear  ‘hat  “  b' ;  (11)  and  then  detennlne 

unlGuely  the  coefficients  in  the  power  series  for  ^(s),  which  are 
just  the  nuirhers  of  (S)  with.  L)  *  log  p )  .  If  the  b^,  ^  ^ 
nonnepative  then  ^(s)  must  be  analytic  in  th.p  interior  of  the  unit 
circle  since  [  1  ^- )  shows  that  is  analytic  for  every  real  s 

between  0  and  1  ;  moreover,  from  (11)  we  nave  1  )  ■  0  so  that 

CD 

(13)  X  b  ^  -  C  . 

j  1  - 

From  (10)  we  see  that  the  p^(t)  satisfy  the  well-known  equations 
dp  (t)  r-1 

(H)  -  S  (r-J)bj,,p^,(t),  r  -  1,  2,  •••. 

but  now  it  is  easily  seen  that  equations  (l/»),  which  are  in  the 
standard  fonn  of  the  differential  equations  for  discontinuous  Markov 
processes,  have  nonnegative  solutions  uniquely  determined  by  the 
initial  conditions 


p^'(0)  -  0  ,  r  /  1  , 

p, (0)  -  1  , 

00 

which  come  from  (7)-(d).  The  general  theory  insures  that  ^  p  (t)  ^  1, 

r- 1  ^ 

GO 

but  the  fact  that  r(l,  1)  ■  f(l)  ■  1  shows  that  ^  p_(t)  •  1  for  all 
t  >  0.  Thus  the  nonnegat iveness  of  the  is  sufficient.  The 

necessity  is  obvious  from  ( 1  i* )  . 

We  shall  obtain  theorem  9b  as  a  by-product  of  Theorem  10. 
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We  observe  thet,  if  f  €  C,  with  f{J)  •  U,  ^  “  implies 

3~  r*^b^<a;  i.e.,  ^"(1-)  vod.  This  canbedocuced  from  11 -c). 

Moreover,  (^"(1  —  )  ce  implies  ^  seems  to  be  difficult 

to  ol  tain  from  (  1  <: )  directly  hut  can  be  demonstrated  ty  actual 
construction  of  Kls,  t)  as  the  solutior  of  (10). 

.suppose  then  that  f  €  C,  f(u)  *0,  ^  ^^'Pr  ""  Section  II 

we  Know  that  the  random  variahles  converge  with  probahility  1 

to  Q  rcindom  variable  w  whose  moment— general i ng  function  ^(s)  satisfies 
j^(.TiS)  ■  f[V(s)^.  Alternatively  we  can  say  that  th<^  random  variable 
z(t}  whose  probati  i  i  ti  es  are  jel'ined  by  (la)  is  Such  t^at  .'or  any 
h>  u  the  jequence  z  ( rd. ) /nz  (  .nh )  ,  n  *  1,  2,  ■**,  converges  with  proba¬ 
bility  1  to  w.  Since  it  is  often  ths  probabilities  bj  which  are 
known  initially  rather  than  the  p^,  it  is  convenient  to  determine 
^(3)  in  terms  of  s ) . 

Theorem  1U.  Suppose  f  €  C,  f(j)  *  0,  ^  ^^Pr  ^  ihe  inverse 

function  of  ^(s)  i_3  el  V  en 

(15)  (i'bu)  -  -(1  -ujexpjj"^  *  -H-7 

(We  recall  that  it' ^  1  )  ■  Icf  fM.l  *  log  m.)  There  are  several  ways 
of  gettinp  !  ^  y )  .  rt’e  start  from.  (12),  which  i.T['lies 


dy 


u  ^  1  <  1  . 
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/  n 

s  m 


Since  the  moment-^eneroti ntr  function  of  z  is  f  (e^  “‘  )  we  have 

^  n  n 


(17) 


lim  f  ( e^  )  “  Re(s)  0 

_ ^  n  — 

n  — ^CD 


(18) 


lim 
n  — >00 


Ts 


lim 
n  — >^00 


m 


n 


■^^*(3),  Ke(s)<0. 

/  n 

.i'e  can  justify  (18)  from  the  fact  th£  t  f^(e‘^^®  ),  •**. 

are  laoment— generating  functions  for  the  random  variables  z^/m.*^, 
v^hose  secona  moments  are  uniformly  bounded.  Now  replace  s  by 
in  (16),  ile(3)  <0,  and  let  n — >od  .  The  left  side  of  (16)  approaches 

^[y(s)]  while  the  right  side  approaches  8^'(i)^*(s).  We  thus  have 
the  differential  equation 

(19)  "  ^'(1)s^’(3),  -CD  <  3  <  0 

which,  together  with  the  condition 

^  (u)  -1 


gives  115). 

Theorem  1^  holds  even  if  f(C)  f  0  provided  m  *=  f'(l)  >  1 

(i.e.,  even  if  /  0  provided  ^'(1)  >  0.)  As  an  example  we  consider 

✓ 

the  caae 

2(s)  •  f^-  [H'  /is  ♦  /s^,  0  <  <  X  , 

/ 
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obtaining 


Thus  the  random  variable  w  is  zero  with  probability  A//,  and 
otherwise  has  an  exponential  distribution.  This  is  a  special  case 
of  D.  G.  Kendall's  "generalized  birth  and  aeath  process,"  [^9]. 

Suppose  now  that  f(s)  belongs  to  class  G  with  r(j)  •  J,  and 
that  fts)  is  entire.  Tnen  it  is  easily  seen  that  /(r)  is  entire, 

and  is  arialytij  in  a  neighborhood  of  u  ■  1;  using  (15)  this 

means  that  ^(3)  is  analytic  in  a  neighborhood  of  s  “  1 .  Since 
f(s)  >  3  for  s  >  1,  and  f'(s)  >  0,  this  mear.s  that  ( 1  < )  can  be  used 
to  extend  s )  analytically  to  the  whole  positive  axis.  Since 

■  0(  “tV  y — have 

'  y  / 


(16) 


< 


03  . 


-1 

From  (18)  and  (15)  we  see  that  /  (u)  approaches  a  finite  limit  L 

as  u — >cu;  that  if-,  ^(L)  -  cu.  But  this  contradicts  the  assumption 
that  ^  is  entire.  Ihus  Theorem  9b  is  proved. 
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^ •  Af:e— d gpe ndent  i  rocesses 

In  the  branching'  prc  cesses  arising  in  biology  the  probability 
thdi  an  object  existing  at  some  time  be  trans i’ormecl  in  a  given  time 
interval  is  not  iridependent  of  the  age  of  the  object;  in  other  words, 
the  age-stecific  birth  and  death  rates  are  not  constant.  This  means 
that  the  ranaom  variaole  z(t),  the  number  of  objects  at  t,  is  not  a 
KaiKov  process  There  are  then  several  possibilities.  We  may  accept 
the  non-Markov  character  of  z(t)  and  work  with  it  as  well  as  we  can; 
or  we  may  choose  to  describe  the  state  of  the  system  at  t  by  a 
function  2(t,  x),  the  number  of  objects  whose  age  is  less  than  x, 
tt;us  restoring  the  .‘•.ar'kov  character;  or  we  may  approximate  by  intro¬ 
ducing  a  finite  nu-mber  of  types,  corresponding  to  age  groups,  and 
use  a  model  of  the  multidimensional  sort  discussed  in  Section  III 
or  the  multidimensional  extensions  of  the  model  of  Section  IV, 

We  shall  consider  the  following  model.  An  object  (of  age  0) 
existing  at  t  ■  0  has  a  cumulative  life— length  distribution  G(t). 

At  the  end  of  its  life  the  ol  ject  is  transformed  into  r  objects 
with  probaoiiity  q^,  r  ■  0,  1,  *'*,  each  having  the  same  life- 
length  distribution  G(t),  and  so  on.  If  the  transformation  is  always 
binary  we  have  the  case  of  bacteriological  fission,  with  which  we 
shall  be  primarily  concerned.  We  shall  summarize  some  results 
obtained  by  Bellman  ana  Harris  [tj  on  the  distribution  of  z(t)  and 
bhen  consider  the  z(t,  x)  process.  Certain  results  about  z(t,  x) 
for  a  related  tut  more  complicated  model  have  been  given  recently 
jy  Kendull  [3],  who  has  also  studied  our  variable  z(t)  for  the  case 
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where  G(t)  is  a  convolution  of  exponential  distributions  [20] , 
Let 

p^(t)  -  Prob[2(t)  -  r] 


U) 


F(s,  t)  -  ^  P-ltje*"  . 

r-0  ^ 


If  the  initial  object  is  transformed  into  r  objects  at  time  y  <  t, 

r 

the  generating  function  for  the  number  of  objects  at  t  is  (F(s,  t— y)J  . 
Thus  wp  see  that  F(s,  t)  satisfies 

(1)  F{3,  t)  -  r  h[F(s,  t-y)jdG(y)  ♦  s[l  -  G(t)] 


where  we  have  put 

h(s)  -  ^  q^s*". 

touation  (1)  determines  F(s,  t)  when  G(t)  and  h(s)  are  given.  Arguments 
similar  to  those  used  for  the  model  of  Section  II  show  that  there  is 
a  positive  probability  that  z(t)  never  vanishes  (and  therefore  goes 
to  cd)  if  and  only  if  ^  r  >  1  . 

If  G(t)  is  a  step-function  with  a  single  step,  equation  (1 ) 
gives  the  iterative  scheme  of  Section  II;  if  G(t)  •  1  —  e  ,  where 
c  is  constant  we  have  the  Markov  case  of  Section  IV  and  in  fact 
equation  (1)  can  be  reduced  to  a  partial  differential  equation  of 
the  type  of  (4),  Section  IV,  in  this  case. 

In  the  remainder  of  this  section  we  shall  be  exclusively  concerned 
with  the  case  ^  r  q^  >  1 .  For  simplicity  of  exposition  we  restrict 
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ourselves  to  the  binary  case  h(s)  ■  s  .  We  also  assume  that  G(t) 
has  a  density  function  of  bounded  total  variation, 

(2)  G(t)  •  r  e(y)dy,  f  |dg(y)I  <00. 

Jo  Jo 

The  case  where  G(t)  does  not  have  a  density  is  discussed  in  [21] , 
a  brief  account  of  which  appears  in  [6 j . 

Equation  (1)  then  takes  the  form 

n  6  2 

(3)  F(s,  t)  -  F  (s,  t-y)g(y)dy  ♦  s  [l  -G(t)]. 
Similarly,  defining 

ri  r2 

F^is,,  S2;  t,,  t^)  -  ^  Pra(t,)-r,,  z(t2)-r2js,  sg 

ri  ,r2 


we  have,  for  t|  <  t^ , 

n  6]  2 

(4)  F^ls,,  S2;  t,,  ta)  F2(s,,  s^;  t,-y,  t2-y)g(y)dy 

2 

♦  8,  I  F  (s2,  t2-y)g(y)dy 

hit, 

♦  S|82[1  -  G(t2)]. 

Uefine 

m, (t )  -  E  z( t) , 

m2(t,  h)  ■E[z(t)z(t^h)J,  h>0. 


Then  R|(t}  satisfies  the  renewal  equation 


(t) 


n>i  (t-  y)g(y  )dy 


4 


1-G(t) 
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and  in2(t,  h)  satisfies  a  similar  equation.  Under  the  hypotheses  (2) 
we  have 


(3) 


(c) 


where 


(7) 


-6i  t 


m, 


(t)  -  n,e^  [^1  ♦  0(^e  jj,  £,  >  0 

ijl^e  [l  *  0{e  ), 


malt,  h)  - 


1  -  2Ia 


8a  >  0 


ni 


e  ^^y  g(y)dy 


^y, 


n®  -2^y 

Ik  “  «  g(y)dy , 

Uq 


and  ^  is  the  positive  number  satisfying 

(6) 


1  0  “  ~$y 

•j  -  /  e  g(y)dy. 

^  do 


-e.t 


It  should  be  noted  that  the  o(«  in  (6)  is  independent  of  h. 

The  derivation  of  (5)  and  (6),  using  "inverse  Tauberian"  methods,  is 
given  in  [21^. 

The  importance  of  (t)  is  evident  if  we  define 


w(t)  “  z(t)  / (n, 


Formula  (o)  gives 

(9)  E[z(t+  h)z{t)]  -  e^^E[z{t)]  [l  ♦  O  («  ^  )]  • 


In  the  case  of  the  Markov  processes  discussed  in  Section  IV,  the 


1  1 

r-v.  '  ^.0 


C  e  on  Lhe  sine  ol'  (  .0 

in  bollicienl  I'or  oun  ;  ;rpo3e,  Ion 

(10)  h  [w(  t  ♦  I. )  -  L  )J  *  O 


IS  r**fii.icnl  by  u.  M  WfVPr' 
osif.f  ii  sbov.",  Lhab 


w  . 


F ro!:i  (10)  wp  have 

Tneorem  1  1  .  Under  the  absuiiipbions 

b(s)  »  3  ,  G(l)  -  /  F(y)dy,  'ir(y)!  ^  , 

t  he  ranoom  variaole  z(t)  /  (n]e^^)  conver>^e3  bo  a  ran  do  ^  va  n  a !  1  e  w 
Kith  probabi  i  ^  b y  1  Ja}  the  sense  tb.a t  for  each  b,  >  0  the  aeouence 
z  (  nh  )  /  (  n )  e*  *^^‘ )  ,  r.  =  1  ,  i  ,  •  •  •  ,  cofiverges  with  probab  i  ^  i  by  1  bo  w. 


hather  tnan  bhe  seouence  we  could  picK  any  sequence  b^.  such 

that  C'(e  ^ )  •'-  aj.  Presumably,  w(t)  converges  to  w  with 

n 

probability  1  in  the  usual  sense  also. 

Defining  ?i(s)  ■  Ke(3)  v  0,  it  can  be  shown  that  ^(s) 

sabisf i es 

r  ®  ^  -oy 

(11)  ^^ (  s )  ■  /  ^^  (  se  )  g (  y  )  dy  ,  he  (  :.  j  ^  . 

0  u 

t 

From  (11)  can  be  obtained  bounds  fo*"  bfie  mapnibuop  of  0(iby  anu  p  (it 
t  real,  as  b  — :>•  ^  qd,  whence  we  get 

Theorem  11.  Tt'.e  d i  s b r i  b u b i on  ^  w  ^  jibsolubely  conb  inuous  . 

Details  are  in  [l 1 ] • 

'Ae  now  consider  bhe  process  z(b,  x),  wncre 
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(lit)  z(t,  x)  ■  number  of  objects  in  existence  at 

time  t  of  age  <  x 

ana  we  introduce 

(13)  M(t,y,x)“  expected  number  of  objects  of 

age  <  X  at  t  if  there  was  one 
object  of  age  y  at  time  0. 

The  function  z(t,  x)  has  been  considered  often  in  deterministic 
population  studies.  It  is  Known  that  under  certain  conditions  the 
age  structure  of  a  population  (under  deterministic  assumptions) 
converges  to  a  limiting  value  (see,  for  example,  Leslie  [22j  and 
Lotka  [23J .  Vie  shall  give  a  probabilistic  analogue  of  this  result 
for  our  model  which  is  also  an  analogue  of  the  "ratio  theorem"  of 
Everett  and  Ulam  (Theorem  6b)  and  is  likewise  connected  with  a  result 
of  Doob  [24J  in  renewal  theory. 

Let  us  first  consider,  heuristically ,  some  properties  of 
M(t,  y,  x).  Suppose  the  age  structure  of  the  population  at  some 
time  t,  is  given  by  the  function  z(ti  ,  x).  The  expected  number  of 
Objects  of  age  <  x  at  time  t]  ♦  t^  is  then 

(14)  /  M(t^,  y,  x)d  z(t, ,  y). 

t/0  ' 

Let  z(t)  be  the  vector  quantity  representing  z(t,  x) ,  considered  as 

T 

a  function  of  x.  We  may  then  define  the  operator  M  by  the 
renuirement  that 

.(15)  m'^K(x)  -  r“M(T,  y,  x)dH(y) 

Uq 

I 
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for  any  I'unclion  }i{a)  ol'  bounded  vai  iabiori  on  (u,  cd).  The  operators 

T 

M  have  l^le  semigroup  property 

T  T  'T 

M  K  -  M 

Ae  car,  nov  wr.t^  tiie  symoolic  equation 
(  H  )  E  [[z  (  t  ♦  h  )  I  7,  (T)  ,  T  t]  -  M^z  ( t )  , 

vshich  is  the  analogue  ol'  (3),  Section  11,  and  (c),  Section  111. 

T 

ihe  oper  itors  M  night  be  called  "positive";  that  is,  they 
lenve  the  cone  of  increasing  functions  of  counaed  variation  ir.vnr-iant. 
Thus  one  woUi.d  exjiect  some  of  the  classical  th.eory  on  matrices  with 
positive  ele.nents  to  carry  over;  in  [^articular,  the  existence  of  a 
/  >  U  anu  an  n  •  rt(x),  an  increasing  function  of  x  such  that  for 
any  H  =  h(x)  whic.h  is  increasing  and  of  bounded  variation, 

(17)  lim  ^  -  c(H)n 

t  —>01 

v.here  c(H)  is  a  linear  functional  of  H;  we  have  not  made  precise  in 
what  sense  the  limit  in  (17)  should  exist. 

rtltliough  a  general  theory  for  positive  operators  has  been  given 
by  Krein  and  nutman  [^^3]  and  Bohnenblust  and  Karlin  [^t]  ,  it  does 
not  appear  to  be  reaaily  applicable  to  the  present  case.  However, 

WG  can  get  tlie  results  we  need  by  usinc  the  fact  that  M(t,  y,  x) 
satisfies  renewal  type  eouations. 

Vi'e  may  define  the  age-ai s tr i  outi  on  of  the  pooulation  at  t  by 
the  ratio  z(t,  x)/z(t).  'we  already  know  from  Theorem  11  the  behavior 
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of  z(t) 
Theorem 

(18) 


f 


for  large  t.  Ve  complete  this  with 
1 3 .  Define 


A(x) 


—  G(u)3<1u 


—  G(u)Jdu 


G(  u)Jdu 


(19)  D(t)  -  sup  [a{x)  -  z(t,  x)/z(t)3  . 

0<sX<» 

Under  the  assumptions  of  Theorem  11 ,  D(t)  — >  0  with  probability  1 
( in  the  sense  of  Theorem  11)  as  t  — >  qd. 


The  function  A(x)  is  the  analogue  of  the  "stable  age  distributions" 
considered  in  deterministic  population  theory. 

although  for  simplicity  we  are  assuming  an  initial  object  of  age  0 
for  Theorems  11,  12  and  13,  the  modifications  for  an  initial  object  of 
arbitrary  age  are  obvious. 

It  is  not  hard  to  see  that  in  order  to  prove  Theorem  13  it  is 
sufficient  to  show  that  for  each  x  >  0, 

(20)  1a(x  )  -  z(  t ,  x)/z(  t)  I  — >  0,  t  — >  ao  . 

'.Ve  do  this  by  defining 

(St 

(21)  w(t,  x)  -  z(t,  x)/(nie  ) 

and  showing  that  w(t,  x)  — >  A(x)w.  The  methods  are  similar  to  those 
of  [213  and  we  only  sketch  the  proof. 
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Let  K(y,  x,  s,  t)  be  the  generating  function  for  the  number  of 
objects  of  age  ^  x  at  t  if  initially  there  was  one  object  of  age  y. 
Then  F  satisfies 

(22)  F(y,  X,  s,  t)  -  sJ(x  -  y  -  t)  [j  -  G(y,  t)3 


X, 


S, 


(23) 


F(0,  X,  s,  t)  ■  sJ(x-t)[i  -G(t)3 


*  Jq  ^  (0,  X,  s,  t-u)g(u)(lu 


where  J(t)  is  the  Heaviside  function:  J(t)  ■  0  for  t  0,  J(t)  *  1 
for  t  >  0;  G(y,  t)  is  the  lifelength  distribution  for  an  object  of 


fcge  y . 


c:(y.  t)  - 


with  the  convention  that  G(y,  t)  and  taken  as  0  if 

G(y)  -  1 . 

Differentiation  of  (22)  and  (23)  with  respect  to  s  at  s  ■  1  gives 


(24) 


H(t,  y,  x)  -  J(x  -*  y  -  t)[l  -  G(y,  t)] 
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|(25) 

\ 

'  Let 


n  ^ 

M(t,  0,  x)  -  J(  X  - 1 )  fl  -  G(  t  )J  *  M(t— u,  0,  x)g{u)du. 


‘/iff-,  x)  -  M(t,  0,  x)e~^^(it. 
u  0 


jsince  M(t,  0,  x)  <  E^z(t)3  •  0(e^^),  V^(ff‘,  x)  is  defined  for  every  d“ 

whose  real  part  is  >  ^ .  Taking  Laplace  transforms  of  both  sides  of 
(^5)  gives 


(26)  H'io',  x) 


e  ^[1  -  G(t)]dt 


1  -  2  g(t)e”^^dt 


The  assumptions  we  have  made  enable  us  to  deduce  from  (26),  in  the 
manner  of  [21^  ,  that 


(27) 


r^e  ^''[1  -  G(t)1dt 
^0 


M(t,  J,  x)  -  - ♦  0(e^^  ^0, 

2  P  t  e  ^^g(  t )dt 
do 


00, 


S  >  0. 


We  can  then  show  that 


(28)  Ki(t,  y,  x) 


te  ^^g(t)dt 


again  with  the  convention  that  g{y*t)/[}  —  G(y)]  is  0  if  G(y)  "I. 
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We  have  used  £  to  represent  a  positive  number,  not  necessarily  the 
same  each  time. 

Thus  we  see  that  the  expected  distribution  of  ages  settles  down 
to  A(x).  To  see  that  the  actual  distribution  of  ages  does  so  we  have 
to  consider  the  joint  distribution  of  z(t],  X)  )  and  z(t2,  X2). 

Define  F(y,  x, ,  S] ,  X2,  S2 ,  ti ,  t2),  for  tj  <  t2 ,  as  the  joint 
generating  function  for  z{ti ,  Xj )  and  z(t2,  X2),  given  that  the  initial 
object  had  age  y.  Then  F  satisfies 

2 

(29)  F(y,x, ,s, ,X2,S2,t, ,t2)  -  /  F  (O.x, ,s, ,X2 ,S2 ,t,-u,t2-u)g(y ,u)du 

Uo 

2 

♦  [J(x,-t,-y)8,  ♦  1  -  J(x,-^,-y)J  J  F  (0,X2 ,82  ,t2-u)g(y,u)du 

♦  (J(x|-t|-y)s,  ♦  1  -  J(x,-t,-y)]  £j(x2-y-t2)s2  ♦  1  -  J(x2-y-t2)l  * 

•[1  -  G(y,t2)]  , 

where  g(y,  u)du  •  dG(y,  u)  •  g(y*u)du/{[l  -  G(y)3  if  G{y)  <  1,  and  0 
if  G(y)  -  1 . 

Put  t,  -  t,  t2  •  t  ♦  T  >  t,  and  let  K{t,  T,  y)  be  the  expected 
value  of  the  product  z(t,  Xj)z(t+T,  X2)  given  that  the  initial  object 
was  of  age  y.  By  differentiation  of  (29)  we  get 

t 

(30)  K(t,T,  y)  -  2^/^  K(t-u,  T,  0)g(y,  u)du 

♦  2  M(t-u,  0,  X|)M(t+T-u,  0,  X2)g(y,  u)du 

t 

♦  2J(xi  -  t,  -  y)  M(t*T-u,  0,  X2)g(y,  u)du 

♦  J(x,  -  t- y)J(x2  - 1 -T- y)  D  ”  t^T)3» 
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We  first  set  y  •  0  in  (30).  It  can  be  shov^-n,  as  in  obtaining  (27), 
that  as  t  — >  00, 


i;  2^t^T  r 

2n,  IjAlx,  )A(Xii)e  [j  ♦Ol®  jj 


(31)  K(t,  T,  0) 


1  -  21; 


for  some  £  >  0.  The  0{e  is  independent  of  T.  We  recall  that 


(32)  n, 


4^J^  e  ^yg(y)dy 


QD 


I2  “  /  e  g(y)dy  , 
0 


A(x) 


G(u)3du  . 


^^-w  consider  the  random  variable 

(33)  V(t,  T,  X, ,  X2)  -  A(x2)w(t,  X, )  -  A(x, )w(t+T,  X2) 

where  w(t,  x)  is  defined  by  (21).  Using  (32),  we  see  that  for  the 
case  where  the  initial  object  is  of  age  0  we  have 

(34)  E[y(b ,  T,  X,  ,  X2 )]  *  0(e  ^^) ,  t  — >  od,  £  >  0, 

with  the  0(®~^^)  in  (34)  independent  of  T.  Putting  x,  ■  X2  in  (34) 
tells  us  that  for  each  x, 

(35)  E[w(t,  x)  -  w(t+T,  x)^  -  C(e  ^^), 

so  that  w(t,  x)  converges  in  mean  square  to  a  random  variable  w(oo,  x). 


-UL- 
l’  -i  5^ 

rpv.  6/14/^ 

Now  usirif,  (  )  i’or  artit^rar'y  X|  and  we  see  that 

(3t)  A(x^)w(au,  X,)  *  A{x,}w((r,  x^) 

with  probat:  lity  1.  Now  w(ai,  aa)  “  w,  the  I'anoom  variable  of  Theorerr.  11. 
Puttir.g  X,  -  oj,  x^  ■  X  in  (  it)  then  p,ives 

(37)  w  ( ou ,  X  )  -  A  ;  X  )  w . 

From  (35)  (JV)  we  '  .ve 

(3^)  E[w(t,x)-/i(x)wJ  -  0(6^^),  t  - >  CL . 

rheorerr,  1}  is  now  a  consequence  of  i36). 
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VI .  Mutations. 

A  multidimensional  analogue  for  the  model  of  Section  V  can 

/ 

be  constructed,  in  which  K  types  of  objects  are  considered.  The 
asymptotic  behavior  of  the  moments  can  be  discussed  using  systems 
of  renewal-type  equations.  We  shall  not  pursue  this  topic  further, 
but  consiaer  a  special  model  for  bacteriological  mutation. 

When  bacteria  are  attacked  by  a  bacterial  virus,  certain  of 
the  bacteria  are  sometimes  resistant  to  the  virus  and  can  transmit 
this  power  of  resistance  to  their  descendants,  h  priori .  two 
hypotheses  would  appear  to  be  possible:  (a)  the  resistant  bacteria 
arose  as  mutations  before  the  virus  was  added;  (b)  there  is  a  small 
probability  that  any  bacterium  survives  an  attack  of  a  virus; 
bacteria  who  survive  an  attack  transmit  immunity  to  their  descendants. 
In  case  (a)  the  bacteria  which  survive  the  original  onslaught  will 
occur  in  ’'clones"  of  various  sizes,  each  being  the  descendants  of  a 
mutant.  In  case  (b)  the  survivors  are  randomly  distributed  throughout 
the  medium. 

The  problem  of  distinguishing  between  (a)  and  (b)  was  attacked, 
using  statistical  methoos,  by  Luria  and  Delbruck  [273*  as  part  of 
the  problem  it  is  necessary  to  consider  the  distribution  of  the 
number  of  bacteria  of  the  mutant  form  (i.e.  ,  mutants  or  their 
descendants)  at  a  given  time  if  the  hypothesis  (a)  is  true.  The 
model  chosen  by  Luria  and  DelbrucK  was  as  follows.  The  main 
bacterial  culture  is  assumea  to  grow  deterministically,  the  number 
at  time  t  being 

h(t)  ■  Ne^ 
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where  N  is  'the  initial  number.  The  probability  that  a  mutation 
arises  in  the  time  interval  (t,  t-t-dt)  is  taken  as  /  Ne^dt  *  o(dt). 
The  descendants  of  a  mutant  increase  deterministically,  the  number 
of  descendants  at  time  T  after  the  mutant  arises  being  e  . 

Let  ^(t)  be  the  number  of  the  mutant  form  at  time  t.  Under 
tt.eir  hypotheses,  Luria  and  Delbruck  give  the  formulas 

E  %(t)  •  />tNe^ 

Variance  ■  ^Ne^(e^  —  1). 

The  distribution  nf  mutations  has  also  been  considered  by  Coulson 
and  Lea,  as  mentioned  in  [26 j ,  who  apparently  assume  deterministic 
growth  for  the  main  population  while  the  mutants  multiply  in  an 
age— independent  probabilistic  fashion.  They  then  determined  the 
generating  function  for  the  number  of  the  mutant  form  at  a  given 
time. 

We  shall  consider  the  application  of  age— dependent  theory  to 
the  mutation  problem.  We  retain  the  assumption  that  the  parent- 
culture  grows  deterministically.  We  have  seen  in  Section  V  that 
this  is  approximately  true  (under  the  hypotheses  of  that  section) 
for  cultures  with  a  large  number  of  individuals.  Following  Luria 
and  Oelbriick  we  take  the  size  of  the  colony  at  t  to  be  Ne^,  with 
a  probability  /’Ne^dt  *  o(dt)  of  a  mutation  between  t  and  t  *  dt. 
Since  the  number  of  mutants  is  relatively  small,  we  take  a 
probabilistic  model  for  their  growth,  assuming  that  F(s,  t)  is 

D 

the  generating  function  for  the  number  of  descendants  of  a  mutant 
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existing  at  a  time  t  after  creation  of  the  mutant;  F(s,  t)  may  be 
the  function  of  Section  V,  but  could  be  taken  as  some  other  function. 

Let  H(N,  s,  t)  be  the  generating  function  for  the  number  of  the 
mutant  form  at  t ,  if  the  mother  colony  had  size  N  at  t  ■  0.  The 
usual  type  of  reasoning  shows  that 


H(N,  s,  t)  ■  e 


-fN  (.'•-!) 


^  t-y)H(Ne^,  8,  t— y)dy. 


We  can  solve  (1)  easily  if  we  think  of  our  stochastic  process  as 
depenaing  on  the  two  "time"  parameters  N  and  t.  Considered  as  a 
function  of  N,  the  process  is  infinitely  divisible,  and  for  each 
Ni  >  0.  Nk  > 

(2)  H(N,,  s,  t)H(N2,  s,  t)  -  H(N,  ♦  ,  s,  t). 


From  (2)  we  can  write 


H(N,  s,  t)  “  exp[NL(s,  t)J 


where  NL(s,  t)  is  the  cumulant— generating  function  for  the  number  of 
mutations  at  time  t.  To  determine  L(s,  t)  we  substitute  (3)  into  (1) 


Considering  the  quotient 


H(N.  8.  t)  -  e 
N 


as  N 


0  shows  that 
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(4)  L(s,  t)  -  -  f{e^  -  1)  ♦  '^J^Q 

Lettinjr  z'(t)  be  the  na-nber  of  the  mutant  form  at  time  t,  we 
have  from  (3)  and  (4) 

(5)  iifz'Ct)]]  ■  />N e^mit  -  y)dy, 

where  m(t)  •  •  If  *.n(t)  ^  nje^,  it  follows  from  (5)  that 

I3-I 

(o)  E[^z*(t)3  /’Nnjte^, 

Similar  expressions  for  higher  moments  can  be  found. 

The  preceding  analysis  is  of  course  valid  only  while  t  is  small 
enough  so  that  the  total  number  of  the  mutant  form  is  negligible 
compared  with  the  number  of  nonmutants. 
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